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Techniques such as the norm-referenced and 
score techniques, commonly used in the identification of 
educationally disadvantaged Students, are critiqued. This study 
applied latent trait theory, specifically the Rasch Model, along with 
teacher judgments relative to the mastery of instructional/test 
decisions, to derive a standard setting procedure for Chapter 1 
programming. Locally designed objectives-based tests, carefully 
matched to the mathematics curriculum and administered to students in 
the Des Moines Independent Community School District, were used to 
identify students in need of remedial assistance in mathematics as 
well as assessing students' overall mathematics achievement. 
Twenty-one Chapter 1 teachers participated in the study, 11 at the 
4th and 5th grade levels and 10 at the 6th grade level. Teacher 
judgments of item difficulty were recorded. The study found that 
results of item calibration analyses confirmed stability of the item 
difficulty estimates for the tests and the groups of students 
studied. It further found that the lack of continuing remediation 
when the results so indicate, can potentially compound their 
deficiences at the succeeding gradw level. Adhering to a 
predetermined "fixed" standard as opposed to a "floating" standard 
can affect a student's future learning experiences. (Author/EGS) 
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ABSTRACT 



That standards are set and utilized to aid 1n decision-making is 
Indisputable. The determination to set standards, the type of information 
collected and the adoption of a standard setting model are all judg- 
mental decisions. One can only ask that the process be reasonable and 
explicit, and those involved 1n establishing a standard are aware of 
what they are doing. 

An area 1n which standard setting is of crucial importance is the 
Identification of educationally disadvantaged students. Each year 
hundreds of thousands of elementary and secondary students are selected* 
on the basis of need to receive remedial Instruction funded under 
Chapter I legislation. The processes engaged' in to make/ these deter- 
minations are as varied as the school districts and people making the 
decisions. Commonly employed techniques, such as the norm-referenced - 
procedure, suffer from many technical problems associated with the 
measurement of the ability of low achieving students;/ inappropriate 
norming populations; in-and-out of level testing, to/name a few. 

Latent trait theory has evolved to the point of ^feasibly employing 
the techniques developed to study the achievement o^ students at varying 

ability levels. This study was directed at applying latent trait 

/' 

theory, specifically the Rasch Model, along with t/eacher judgments 
relative to the mastery of instructional /test dec/isions to derive a 
standard setting procedure for Chapter I programming. 
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That standards are set and utilized to aid in decision-making is 
Indisputable, The assignment of course grades, the admission of students 
Into graduate programs, the selection of a candidate for a job, being 
licensed to oractlce law, architecture or medicine, and the assignment of 
students to r radial educational programs are everyday examples of situa- 
tions where the careful consideration of standards of performance or abil- 
ity comes Into focus. The process of standard setting, by its very nature, 
is a subjective undertaking, depending almost entirely on human judgment. 
Standards are set because it 1s believed that imperfect standards are 
better than none, and in order to introduce a degree of objectivity Into 
the decision-making dilemma. The determination to set standards, the type 
of information to be collected, the adoption or creation of a standard 
setting model are all judgmental decisions. One can only ask that the 
standard-setting process be reasonable and explicit, and that those who 
are involved in establishing or making decisions on the basis of a stan- 
dard are aware of what they are doing and why. 

An area 1n which standard setting is of crucial importance is the 
identification of educationally disadvantaged students in need of reme- 
dial assistance. Each year hundreds-of-thousands of elementary and sec- 
ondary students are selected on the basis of "need" to receive remedial 
instruction in a variety of subject area programs funded under Chapter 1 
legislation. The processes engaged in to make these determinations are 
as varied as the school districts and people making the decisions. Fed- 
eral regulations call for a selection procedure that is systematic, uni- 
fbrm and as objective as possible. 

1 
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At present, the two commonly employed techniques to establish a 
cut-off score (criterion score or standard for selection) are the norm- 
referenced and average-score procedures. The norm-referenced procedure 
involves administering a nationally standardized test and designating a 
score (percentlle)as the standard below which students will be provided 
remedial assistance. The averaye- ,core technique, often used by school 
districts testing with lo? "ly developed instruments, establishes the 
district* s test average, or „ score slightly below 4hat point, as the 
criteri|On. 

The most disturbing drawbacks associated with the norm-referenced 

i * ■ 

procedure are: 1)- different "standardized" tests produce different 

i ', } 

results; 2) inappropriate normlng populations; 3) Inappropriate content 

j 

relative to a district's curriculum; and 4) problems associated with 
the measurement of low ability students (because standardized tests are 

m 

targeted at average ability levels). 

A fundamental problem associated with the average-score procedure 
is the variability of a district's average test score measured from 
year to year. As a district's average test score increases, that is, 
as students appear to be getting smarter (or the test easier), the 
criterion goes up. Similarly, as. a district's average score decreases, 
students appear to be getting dumber (or the test has gotten harder), 
the standard goes down.- Consequently, the standard is dictated by the 
interaction of the varying ability of the student population and the 
varying difficulty of the test (without cognizance of or control over 
this confounding interaction) rather than 1/eing controlled by instruc- 
tional priorities. The standard is, 1n essence, established opportunisti- 
cally after-the-fact, instead of representing any predetermined guidelines. 
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Traditional psychometric methods for constructing and analyzing 
assessment tests encounter problems with the mesurement of achievement 

4 

for both low and high ability groups. The achievement of differing abil- 
ity groups cannot be assessed with tests which are not population invari- 
ant (i.e., tests that do not have the same psychometric characteristics 
across the populations being studied) in a way which preserves the con- 
sistency of a standard setting process. 

The necessity of test Invariance has been recoonlzed in the pscho- 
metric literature for 60 years. The calibration of test item difficulty 
must be independent of the ability distribution of the population used to 
establish item difficulty estimates. The measurement of person ability 
must be independent of the particular test items used for the ability 
measurement. Consequently, the measure estimated for a test score must 
be an estimate of a person's ability which is freed from the difficulty 
distribution of the items comprising the test (i.e., an easy or hard test 
must lead to statistically equivalent estimates of a student's ability). 
Likewise, an estimate of an item's difficulty must be freed from the abil- 
ity distribution of the calibrating population. Advances in latent trait 
theory, specifically the Rasch model, have evolved to the point where it 
has become feasible to accurately assess the achievement of students of 
varying levels of ability and concomitantly to make an objective explica- 
tion of the standard setting problem. 

A second phase of the standard setting process is the establishment 
of a priori criteria based on the expert judgments of qualified profes- 
sionals and the translation of these judgments into test outcomes. In 
standard setting situations where either a norm-referenced or locally 
developed test is administered, decision makers specify a score criterion 



• after the results of testing are 1n hand. This specification is domi- 
nated by concern over how many students can be servt*: given fiscal and 
staffing resources and whether the truly needy students have been identi- 
fied. Fixation on any particular total score, as 1f 1t were Interpre- 
table (without giving careful consideration to the test Items passed or 
objectives mastered) often leads to confusion and even mlsldenti ficatlon 
of students. This is because there exists no clear idea in the decision 
makers' mind as to what the score means and what Its use Implies with 
respect to instruction. This line of reasoning does not dismiss fiscal 
concerns and program resources, but 1t suggests that a better accounting 
of the dollars can be provided 1f the standard setting process is coupled 
with the interpretabll ity of a test score in a way that 1s well under- 
stood by those who establish the criterion and allocate remedial instruc- 

* 

tional services. 

. Although the utilization of subject matter experts is 'not unique to 
the standard setting process to be discussed (the Nedelsky, Angoff, Rhel 
and Contrasting Groups procedures are techniques used to set standards 
on minimum competency tests employing, expert judgment), the population 
free item difficulties provided by a Rasch analysis enable the experts to 
focus their judgments on a standard expressed in terms of item content in 
a way wi ch 1s independent of population idiosyncrades. The explana- 
tion and utilization of a standard can be enhanced, 1f those who are to 
employ it understand what it means, how to use it, and have contributed 
to its establishment. 

t 

4 



9 

ERIC 



7 



STANDARD SETTING UTILIZING 



THE RASCH MODEL 



Locally designed objectives-based tests, carefully matched to the 
mathematics curriculum of kindergarten through eighth grade have been 
administered each spring to all kindergarten through eighth grade stu- 
dents in the Des Moines Independent Community School District. These 
tests, 1n addition to assessing, overall mathematics achievement, have 
been utilized as screening Instruments 1n all Chapter I schools to 
identify students in need of remedial assistance in mathematics. Each 



year a score at or slightly below the school district's average has been 
identified as the cut-off score over the period of test utilization, an'! 
set after the results of testing have been examined. The final choice of 
a standard has been based upon the monies available and consequently the 
number of children that could be provided service. This standard is 
dictated by student results and not deduced from prior judgment. 

The Involvement of teachers 1n the determination of an a priori 
standard proceeded 1n the following fashion. Twenty-one Chapter I 
Instructors, considered to be raster teachers, were selected to partici- 
pate 1n the study by the school dlstr'ct's Director of Chapter I services, 
the Chapter I mathematics coordinator and the school district's Super- 
visor of Mathematics. Of these 21 teachers, 11 were selected to partici- 
pate in standard setting at the 4th and 5th tirade levels and 10 were 
chosen to work on setting a standard for the 6th grade test. 

Each teacher was furnished a copy of the appropriate grade level test 



and a recording form (see Appendix A for an example). The teachers were 
instructed to indicate on the\recordi ng form which test items an "average" 




9 

ERIC 



5 



Chapter I student would answer correctly at least 50 percent of the time. 
Each teacher worked Independently and was allotted one week to complete 
the task. After the results from the first round were tabulated, each 
teacher was furnished a copy of the group results in addition to their own 
initial judgments and Instructed to study these results and make any 
changes in their first Impressions which they felt were warranted. Once 
again each teacher worked independently and was given one week to complete 
the task. The results of the second round indicated those items which 
these teachers felt an average Chapter 1 participant would most likely 
pass. Following the tabulation of the results of the second round, the. 
teacher judgments for each jtem on a given test were transformed into 
estimates of item logit difficulties for analysis (the BICAL program 
reports item difficulty estimates in logits, see Best Test Design, Wright 
and Stone, 1979), utilizing equation 1: 

Teacher judgment 1 
difficulty estimate 
for item i 

In addition to the teacher judgment estimates, each of the tests were 
analyzed with BICAL and the corresponding student performance item 
difficulty estimates were obtained from the fourth through sixth grade 
student performances. 



Equation 1 is a modification of the item logit difficulty estimate 
appearing in Best Test Design. The addition of .5 in the numerator 
and denominator is to adjust for those items for which all teachers 
indicated pass or all indicated not pass. See Wonnacott and Wonnacott, 
Regression: A Second Course 1ji Statistics, 1981, ,for a discussion. 



no of teachers not indicating pass for 

, . item i + .5 

1 09 I no. of teachers indicating pass for 
item 1 + .5 




/ 

CRITERION. SCORES BASED U^ON DIFFICULTY ESTIMATES 

To derive a criterion score from these two Independent estimates of 
item/il.fflcul ties, the/student performance difficulties estimated by the 
BJCAL program were regressed on the teacher judgment difficulties. 
Because these sets of Item difficulties are both estimates, ordinary 
least squares (OLS) regression on an error free Independent variable 
is not appropriate. In this instance the OLS estimate of the slope 
coefficient is replaced by the ratio of the standard deviation of 
student performance difficulty estimates (S d ) divided by the standard 
deviation of teacher ludgment difficulty estimates (S^). Thus, in the 
regression equation d = A + Bt, B 3 S d /S t . The vertical intercept A, is 
the estimate of the criterion score and is defined in the usual manner; 
A = I - Bt , where ~5 is the mean of the student performance difficulty 
estimates and t is the mean of the teacher judgment difficulty estimates. 
An approximation for the standard deviation of criterion score A, is: 




where L 1s the number of test Items, B is the constant calculated above, 
and "J, t are Independent. 

CRITERION SCORES BASED UPON ABILITY ESTIMATES 

The preceeding section outlined the derivation of a criterion score 
based upon teacher and student difficulty estimates. A second approach 
tp estimating a standard based on teacher estimates of student ability 
follows. 
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Each individual teacher's judciments on the items for each of the 
three grade level tests is totaled to yield a test score (1 = Pass 
item 1; 0 = Fail item i). These total scopes are then transformed 
Into estimates of criterion abilities by the PROX technique described 
in Best Test Design (Wright and Stone^ 1979): 

b, * H + G log Ofc/U «*C)3, teacher estimated ability (3) 
J criterion 

where ^Ti s number of Items indicated "pass" by teacher j 

4 

L ■ total number of test items 

L 

H = ^d 1 ./L, average item difficulty 
1=1 

G 8 [1 + V/1.7 2 ] 1 ^ 2 , item variance expansion factor 

V = 12^- 2 - LH 2 ]/(L - 1), item difficulty variance 
1 = 1 

Once each teacher's raw score is transformed into an estimate of 
criterion ability, these estimates are edited for outliers and averaged 
to yield a cut-off score for each grade level test. The standard devi- 
ation of the teacher estimates over the group' of teachers serves as an 
indication of the coherence of the standard. 
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ABILITY MEASURES AND ITEM CALIBRATION INVARJANCE 

Before applying the techniques outlined 1n the previous section a 
check of the 1nvar1ance of Item calibrations across the groups examined,, 
within grades four through six, was conducted. Table 1 presents a 
description of the partitioned groups within grade level. For example, 
at 5th grade, 35 students participated in Chapter I mathematics reme- 
diation, 1n the 1981 -82"schoo1 year, and on the basis of their spring 
1982 test scores were served during the 1982-83 school year as 6th 
graders. One hundred twenty-two 5th graders were served during the 

1981- 82 school year, but on the basis of their fifth grade spring test 
scores were deemed Ineligible for service as sixth graders the follow- 
ing school year. Finally, 50 students in Chapter I schools, not served . 
as 5th graciers were identified, on the basis of their fifth grade 
spring "82" test scores, and eventually served by Chapter I in the 

1982- 83 school year as 6th graders. A total of 207 students comprised 

r V 

tne 5th grade group. Only those students for which complete test 
information existed across the grade levels were included in the study. 
This resulted in approximately 90 percent of the students being Included 
1n the studx f° r each °f the 3' grade levels. 

Item difficulty calibration estimates for the entire group of 
students, at each grade level, were plotted against the difficulty 
estimates for the three partitioned groups to examine item difficulty 
invariance. Figure 1 presents the plot and the 99 percent confidence 
Interval, of the difficulty estimates (5th grade test has 55 items) for 
the population of fifth grade students versus group one's (students 
ierved in both the 1981-82 and 1982-83 school years) item calibrations. 
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Figure 1 
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Figure 1 (cont'd) 

GRADE 5 ITFM CALIBRATIONS: COMPARISON OF GROUP I TO ALL STUOENTS 55 PAIRS 
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TABLE 1 

Breakdown of Student Groups by Year of Chapter I Service 



Grade 
Level 



In Chapter I 
for the 81-82 
and 82-83 
school years 
(N - 35)* 



Group 



In Chapter I 
for the 81-82 
school year 
and not the 
82-83 school 
year 

(N * 102) 



Not In Chapter I 
for the 81-82 
school year but 
1n for the 82-83 
school year 
(N » 46) 



"~xn — 

Students 



N » 183 



In Chapter I 
for the 81-82 
and 82-83 
school years 
(N » 35) 



In Chapter I 
for the 81-82 
school year 
and not the 
32-83 school 
year 

(N * 122) 



Not in Chapter I 
for the 81-82 
school year but 
In for the 82-83 
school, yjear 
(N = 50) 



N => 207 



In Chapter I 
for the 81-82 
and 82-83 
school years 
(N * 34) 



In Chapter I 
for the 81-62 
school year 
and not the . 
82-83 school 
year 
(N s 86) 



Not in Chapter I 
for the 81r82 
school year but 
in for the 82-83 
school year 
(N - 52) 



N = 172 



*Note: Numbers in parenthesis indicate the number of children falling 
in each of the three categories examined. 
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Overall Item calibrations remained stable with a few exceptions. 
Those items which He outside the confidence Interval region do reveal, 

j — -however, -anHn t ere st i ng -phenont enon, " 1 nst yqcTtpnaT sensi tivi ty 

Referring to figure one, the horizontal axis represents the Item call- •* 
bratlons of all fifth grade students, while the vertical axis represents 
the plot of item calibrations for fifth grade, group one students. 
Those items lying below the confidence control lines (#°0, 29, 30 and 
33) are all division problems, with or without remainders. They are, 
since they He below the confidence band, much easier for group one 
students than for the group as a whole,. Conceivably, this group of 
students received the necessary amount of Instruction to overcome their 
difficulties relative to division problems. 

Those items lying outside and above the confidence band (#37, 39, 44, 
48, 49 and 53) were more difficult for the group one students as compared 
to the total population. Three of the items (#44, 48, and 49) are 
measurement items, area of a rectangle, measure of an angle using a 
protractor and the average of three numbers; , items 37 and 53 are decimal 
numeration problems; and item 39 is a geometry item. These items, 
represent a different and possibly higher order conceptual understanding 
as compared to the mechanics of division and less intructional time was 
probably devoted to these higher order concepts to insure that students 
know the rudements of calculating (Appendix B contains the complete 

! results of the item invariance analyses). Overall the results of the 

! 

• ! item calibration analyses confirm stability of the item difficulty 
! estimates for the tests and groups of students studied. The evidence of 
the stability of item calibration implies the stability of ability 
measures and subsequently permits the application of a standard setting 

ERIC 1 7 



procedure circumventing the concerns of traditional psychometric prob- 
lems outlined in the introduction. 

APPLICATION OF THE TECHNIQUES 

An earlier section outlined two techniques which incorporate teacljer 
judgments in the framework of an "objective" measurement process (Rasch 
Model), to establish a priori content-based test standards for the 
identification of students in need of remedial mathematics instruction. 
Since both techniques are mathematically equivalent in terms of the 
resulting cut-score (see interim report, March 1983), the results for 
setting criterion scores' based upon ability estimates will be presented. 
Table 2 presents the resulting cut-score, in logits and their respective 
raw score values. After each teacher's raw score was converted to and 
ability estimate, outlined on pages.seven and eight, outliers were 
removed by including only those estimates lying within plus or minus one 
standard deviation from the teacher's average ability estimate. 

Figures 1, 2 and 3 present the results of mathematics testing at 
fourth grade in the spring of 1982. In each figure the total test raw , 
score, frequency count, unconditional student ability estimate corres- : 
ponding to a particular raw score, error estimate, and frequency distri- 
bution are displayed. In addition, the error bands centered on the 
teacner derived cut-score are depicted (refer to Table 2 for derived 
cut-score and error bands). 

Figure 1 refers to the group of fourth grade Chapter I students 
(N = 35) who were served in 1981-82, tested in the spring, 1982, and 
eventually served in the 1982-83 academic year. Based upon the testing 
results relative to the error band, three, students (8.6 percent) scored 

14 
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TABLE 2 



A Comparison of District Established and Model Derived 
Criterion Test Scores 



Grade 
Level 


District 
Criterion 
Spring 82 


# of 
Test 
Items 


Log1 1 


Ability Method 
Cut-Score 

Standard Equivalent 
* Raw Score 


Error Band 
Logits 


Error Band 
Raw Score 


4 


34 


50 


.42 


.29 


29 


(.13, .71) 


(26, 32) 


5 


33 


55 


-.05 


.24 


27 


(-.29, .19) 


(24, 29) 


6 


35 


60 


.21 


.12 


32 


(.09, .33) 


(31, 34) 



well above the cut-score and outside the error or retest band. Twenty- 
one students (GO percent) scored below the lower limit of the error 
band, while eleven students (31.4 percent) fell within the error band. 
The error band functions to identify those students who should probably 
be retested to verify their scores before a final determination is made 
to serve those Individuals. Consequently, according to the results pre- 
sented, three students scored high enough on the test to question their 
eligibility for further service. 

Figure 2 presents the results of the group of fourth grade students 
(N = 102) who were served in the 1981-82 school year and were determined 
Ineligible for service 1n the 1982-83 academic year. Based upon the 
tests scores relative to the estimated criterion score, 64 students 
(62.7 percent) scored above the upper limit of the retest (error) band; 
24 students (23.5 percent) fell within the retest region and 14 individuals 
(13.7 percent) fell below the error band and probably should have been 
given further consideration relative to a second year of remediation. 
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TABLE 3 



Summary of Eligibility Decisions Based Upon the 
Teachers Predetermined Cut-Score 



Grade Four 
N * 183 



f 


Group I 
N * 35 


Group 11 
N 3 102 


Group III 
N = 46 


Above Error's and 


3* 


64 


7* 


Within Error Band 


11 


24 


21 


Below Error Band ! 


.21 


14* 


18 


i 

Grade Five 
N » 207 




Group I 
N = 35 


Group II 
N =» 122 


Group III 
N * 50 


Above Error Band 


3* 


83 


10* 


Within Error dand 


13 


27 


20 


Below Error Band 


19 


12* 


20 


Grade Six 
N ■ 172 




Group I 
N * 34 


Group II 
N * 86 


. Group III 
N =» 52 


Above Error Band 




42 


20* 


Within Error Band 


10 


9 


14 


Below Error Band 


15 


35* 


18 



indicates the number of students for which an Improper determination 
as to. eligibility was made based upon the teacher derived cut-score 
as compared to the district's existing standards. For example, for 
fourth grade, three students 1f< Group I who were served 1n both the 
1981-82 and 1982-83 school year scored well above the cut-score and 
outside the reteSt (error) band, and consequently should have not 
been declared eligible for service based upon their test results. 
The text provides a complete description of the table. 
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Finally, the results of the group of fourth grade students (N * 46) 
tested 1n the spring of 1982, and served for the first time in the 
1982-83 school year are presented in Figure 3. Seven students (15.2 
percent) fell outside and above the error band and possibly did not need 
further service; twenty-one (45.7 percent) fell within the retest band 
and eighteen (39.1 percent) fell outside and below the error band. 
Based upon the results of the entire fourth grade population examined 
here (N 3 183), 24 students (13.1 percent) on the basis of their test 
score, relative to the error band, should or should not have been 
served relative to the group they were in. A total of 56 students 
(30.6 percent) fell inside the retest region and should have been 
retested to verify their scores. Of the total group 103 individuals 
(56.3 percent) were correctly identified to be served or not served. 
Appendix C contains the results for the fifth and sixth grade analysis. 

Table 3 presents a summary of the results for each of the three 
grade levels. In fifth grade a total of 25 (12.1 percent) students 
were improperly identified relative to the group they resided in; 60 
(28.9 percent) fell in the retest (error) band, and 122 (58.9 percent), 
were correctly identified based upon the teacher established Criterion ' 
score. In sixth grade a total of 64 (37.2 percent) students were 
incorrectly identified relative to their group, 33 (19.2 percent) fell 
in the retest zone and 75 (43.6 percent) were properly identified. The 
reader should recall that the information presented in Table 1, reflects 
the service and no service conditions as they existed at the time of 
the study based upon the district's and not the teacher derived cut-score. 
Furthermore, the results discussed in this section and depicted by Figures 
1,2 and 3 and Appendix B represent a comparison of decisions based 
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MAX . Of 2 CATEGORIES 



SCALE SCORE EQUIVALENCE TABLE 
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Figure 2 

: GRADE 4 MATH, GROUP-2 STUDENTS 
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Figure 3 

GRADE 4 MATH. GROUP-3 STUOENTS 
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upon the teacher derived standard versus the existing conditions based 
upon the district's standard. 

It is clear frnro the results presented that the greatest error 
associated with a determination of service or no service is concentrated 
at the sixth grade level. The reasons for this situation are not 
entirely apparent, but one reasonable speculation can be advanced relative 
to the information presented in Table 3. Of the' three groups studied 
within the three grade levels, Group 1 has the smallest proportion of 
students served in two successive years (1981-82/1982-83) relative to 
Group 2 students served in 1981-82, or Group 3 students served for the 
first time in 1932-83. For those fourth grade students falling in Group 2, 
and served only in 1981-82, 14 (13^7 percent) of the students, on the 
basis of the a priori' standard, should have been served as fifth graders, 
and were not. The number could potentially inv ease based upon the 
retesting of those students in Group 2 (24 or 23.5 percent) falling in 
the error (retest) band. Consequently, for those fourth graders served 
in 1981-82 and not served as fifth graders, the lack of continuing 
remediation when the results so indicate, can potentially compound 
their deficiences at the succeeding grade level (in this case fifth 
grade) and eventually result in those students being selected for 
service at the sixth grade after two full years of being behind! 
Subsequently, the lack of adhering to a predetermined "fixed" standard 
(along with suitable accompanying anecdotal information) as opposed to 
a "floating" standard can result in an in-and-out migration pattern 
within the Chapter II program, vis-a-vis successive years of continuous 
remediation, adversely affecting a student's future earning experiences. 
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APPENDIX A 
Example Teacher Recording Form 
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Name 



Stop at item # 



Judges Recording Form 
4th Grade Math 
Addition Strand 

Group Decision _ 



/■ 



Item 



1. 
2. 
3. 
4. 
5. 
6. 
7. 
8. 



Ycur Group Incorrect/ Group 
Oecision Decision Option Most Decision 
P F Often ChoWn ^ 

•A B .C-'-D., X, - 



Stop at item # 



Subtraction Strand 
Group Decision _ 



Item 



Your Group 
Decision Decision 
P F 



Incorrect Group 
Option Most Decision 
Often Chosen 
A B C D E 
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9. 
10. 
11. 
12. 
13. 
14. 
15. 
16. 
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Stop at Item I 



4th Grade Math Continued 
Multiplication Strand 
Group Decision 



Item 



Your Group Incorrect Group 
Decision Decision Option Most Decision 
P F Often Chosen 

A p C D E 



17. 
18. 
19. 
20. 
21. 
22. 
23. 
24. 
25, 
26. 



"f 



Stop at item # 



Division Strand 
Group Decision 



Item 



Your Group Incorrect Gtaup' 
Decision Decision Option Most Decision 
P F Often Chosen 

A B C D E 
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27. 
28. 
29. 
30. 
31. 
32. 
33. 
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4th Grade Math Continued 



Numeration Strand 
Stop at Hem # Group Decision 



Item Your Group Incorrec* Group 

Decision Decision Option Most Decision 
i P F Oi ten Chosen 

I A B C D E 

34. 
35, 
36. 
37. 
38. 



Geometry Strand 
Stop at item # Group Decision 



39. ; \ « 
40. 



Item Your Group Incorrect Group 

Decision Decision Option Most Decision 
P . F Often Chosen 

A B C D E 




Stop at Item I 



4th Grade Hath Continued 
. Fractions Strand 
Group Decision 



Item 



Your Group ■ Incorrect Group 
Decision Decision Option Most Decision 
'P F Often Chosen 

A B C D E 



41. 
42. 
43. 
44. 



Stop at Item # 



Item 



Measurement Strand 
Group Decision 



Your Group 
Decision Decision 
P F 



Incorrect Group 
Option Most Decision 
Often Chosen 
A B C D E 



45. 
46. 
47. 
48. 
49. 
50. 
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• APPENDIX B 

Fourth, Fifth and Sixth Grade 
Item Invariance Plots 



(Note: see Figure 1, page 10, for Invariance plot for fifth grade, 
group 1 vs. all fifth graders.) 
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PAIRS- 50 



GROUP A. ITEM CALIBRATIONS FROM GRADE 4, GROUP 1 
GROUP B ITEM CALIBRATIONS FROM GRADE 4, ALL STUDENTS 
THE CONFIDENCE INTERVAL REPRESENTS 4. STANDARD ERRORS 
CREATED BV L.N, LUDLOW: MESA ♦ THE UNIVERSITY OF CHICAGO 
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GRADE 4 | f EM CALIBRATIONS: COMPARISON OF GROUP t TO ALL STUDENTS 50 PAIRS 



NOiE II IE HOIS REPRESENTING THE STANDARD ERROR BANDS ARE ENTERED INTO THE GRAPH LOCATIONS AFTER THE NUMERALS. THIS MEANS 
f HAT PAIRS FALLING AT THE SAME LOCATION AS DO DOTS ARE NOT SHOWN ANO THE TOTAL NUMBER OF OCCURENCES THAT COULD BE 
COUNTEO IN THE PLOT WILL NOT EQUAL THE NUMBER OF PAIRS ACTUALLY PLOTTEO. THIS CHOICE WAS MADE AS AN AID IN HIGHLIGHTING 
WHERE • I HE BANDS "LIE ANO WHICH PAIRS CLEARLY LIE OUTSIDE THE BAND . PAIRS FALLING ON OR OUTSIDE THE BANDS ARE 
LISTED IN THE FOLLOWING TABLES 
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GRADE 4 ITEM CALIBRATIONS: COMPARISON OF GROUP 2 TO ALL STUOENTS 



50 PAIRS 



SCALED PLOT OF TWO ITEM CALIBRATIONS 
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GROUP A: ITEM CALIBRATIONS FROM GRADE 4, GROUP 2 
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GRADE 4 It EM CALIBRATIONS: COMPARISON OF GROUP 2 TO ALL STUDENTS 



50 PAIRS 



NOTE: THE DOfS REPRESCN'T INO THE 
THAT PAIRS FALLING AT THE 



WHERE THE BANDS L 



COUNTED IN THE «PL3t WILL NOT EQUAL THE 



STANDARD ERROR BANDS ARE ENTERED INTO THE 
SAME LOCATION AS DO DOTS ARE NOT SHOWN *N0 



GRAPH LOCATIONS AFTER THE NUMERALS. THIS MEANS 
THfc TOTAL NUMBER OF OCCURENCES THAT COULD BE 



!EjB or PAIRS ACTUALLY PLOTTED . THIS CHOICE WAS MADE AS AN AID IN HIGHLIGHTING 



LISTED IN THE FOLLOWING TABLES 
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•0.33 


9 


I T09 


-0 82 


-0.49 


0 . 33 


10 


I 1 10 


-0 42 


-0 01 


0 40 


20 


I T 20 


-1 .06 


-0 54 


-0.52 


7 \ 


IT21 


-1 .37 


0 54 


0 83 



V- 



ERIC 



38 



39 



GRADE 4 ITFM CALIBRATIONS: COMPARISON OF GROUP 3 TO ALL STUDENTS 
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GRADE 4 ITEM CALIBRATIONS: COMPARISON OF GROUP 3 TO ALL STUDENTS 
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WHERE THE BANDS LIE AND WHICH PAIRS CLEARLY LIE OUTSIDE f HE BAND . PAIRS FULING ON OR OUTSIDE THE BANOS ARE 
LISTED IN THE FOLLOWING TABLES 



SCALED 


POINTS' BELOW ERROR 


BAND 




ID 


NAME 


X AX 1 S 


V- AXIS 




OIFF 




20 


1 T20 


0 tt 


-0.54 


0.65 


to 


If to 


0 . 38 


-o.ot 


0.40 


21 


1121 


-0 t7 


-0.54 


0.37 


♦ 5 


1 T 15 


0.60 


0 25 


0.36 


9 


1109 


-0. t7 


. -0 49 


0.32 


t 1 


IT 1 1 


-0.03 


-0.30 


0.27 


SCAt ED 


POINTS 


ABOVE ERROR 


RAND 




ID 


njamf. 


X AXIS 


V AXIS 


DIFF 












37 


1T37 


0. t t 


0.38 


-0.27 


28 


IT28 


-0.90 


-0.49 


-0.41 


40 


1T40 


-0 32 


0. It 


-0.43 



41 



42 



GRADE 5 ITEM CALIBRATIONS: COMPARISON OF CROUP 2 TO ALL STUDENTS 



55 PAIRS 



SCALED PLOT OF TWO ITEM CALIBRATIONS 



H 
A 
R 
D 
E 
R 



5 00 ♦ 



B 

D 
I 

r 

F 
I 

C 

u 

L 
T 

V 



E 
A 

S 
I 
F 
R 



ERJC 



o oo ♦ 



5 00 




5 OO 
EASIER 

MEAN A ■ 
MEAN B* 



O 00 
0.00 



-O.OO 
A DIFFICULTY 

SA + 1.O0 
SB** 1.00 



5 

HARDER 

R« 0 99 • RMAX * 0 99 
PAIRS* 55 



00 



GROUP A: ITEM CALIBRATIONS FROM GRADE 5. GROUP 2 
GROUP B: ITEM CALIURAtlONS FROM GRADE 5, ALL STUDENTS 
THE CONFIDENCE INTERVAL REPRESENTS 4, STANDARD ERRORS 
CREATED BY L.H LUDLOW* MESA. THE UNIVERSITY OF CHICAGO 
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GRADE 5 ITEM CALIBRATIONS; COMPARISON OF GROUP 2 TO ALL STUDENTS 



55 PAIRS 



NOTE THE DOTS REPRESENTING THE STANDARD ERROR BANDS ARE ENTERED INTO THE GRAPH LOCATIONS AFTER. THE NUMERALS . THIS MEANS 
THAT PAIRS FALLING At THE SAME LOCATION AS 00 OOTS ARE NOT SHOWN A NO THE TOTAL NUMBER OF OCCURENCES THAT COULD BE 
COUNTED IN THE *LOT WILL NOT EQUAL THE NUMBER OF PAIRS ACTUALLY PLOTTED. THIS CHOICE WAS MADE AS AN AIO IN HIGHLIGHTING 
WHERE THE BANDS LIE AND WHICH PAIRS CLEARLY LIE OUTSIOE THE BANO. PAIRS FALLING ON OR OUTSIOE THE BANDS ARE 
LISTEO IN THE FOLLOWING TABLES 



cr ii rn 


on t kjT c 

I'll INI j 


DCLUW CHKUH 


RAMTI 
CiANU 




f n 


IMA PIC 




V A V 1 C 


n if r 


3 


1103 


- I .08 


-1 .53 


0.45 


IB 


IT 38 


-0.25 


-0 . 44 


O. 19 


49 


IT49 


0.79 


0.63 


0. 16 


SCAl ED 


POINTS 


ABOVE ERROR 


BAND 




10 


NAME 


x ax;s 


Y AXIS 


birr 


23 


IT23 


-0 06 


, 0 10 


-0 16 


7 


IT07. 


-028 


-0.O8 


-0. 19 


8 


I TOO 


0> 54 


0 73 


-0. 19 


17 


i r 17 


O.B2 


1.02 


-O. 19 


29 


IT 29 


-0 60 


-0 . 39 


-0.21 



45 



44 



GRAOE 5 HEM CALIBRATIONS': . COMPARISON OF GROUP 3 TO Alt STUDENTS 55 PAIRS 



M 
A 

R 
D 
E 
P 



4 OO 



■ . / 
SCALED PLOT OF TWO ITEM/CALIBRATIONS 

/ • 




•1.00 ♦ 

-4 OO 
CASIFR 



-000 
A DIFFICUl TY 



MEAN M * 
MEAN B** 



0 00 
0 00 



SA* 
SB« 



1 00 

1 .00 



tt« 0.96 RMAX« 0.97 
PAIRS* 35 



9 

ERLC 



GRObP A: ITEM CALIBRATIONS FROM GRADE 5. GROUP 3 
GROUP B : ITEM CALIBRATIONS FROM GRADE 5, ALL STUDENTS 
THE CONFIDENCE INTERVAL REPRESENTS 4. STANDARD ERRORS 
CREATED BY l.H. LUDLOW: MESA, THE UNIVERSITY OF CHICAGO 
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GRADE * ITEM CALIBRATIONS: COMPARISON OF GROUP 3 TO All STUDENTS 55 PAIRS 



NOTE: THE DOTS REPRESENTING THE STANDARD ERROR BANDS ARE ENTERED INTO THE flRAPH LOCATIONS AFTER THE NUMERALS . THIS MEANS 
THAT PAIRS FALLING AT THE SAME LOCATION AS 00 OOTS ARE NOT SHOWN A NO THE TOTAL NUMBER OF OCCURENCES THAT COULO BE 
COUNTEO IN THE PLOT WILL NOT EQUAL THE NUMOER OF PAIRS ACTUALLY PLOTTED THIS CHOICE WAS MADE AS AN AIO IN HIGHLIGHTING 
WHERE THE 8AN0$"L1E ANO WHICH PAIRS CLEARLY HE OUTSIDE THE BANO . PAIRS FAILING ON OR OUTSIDE THE BANDS ARE 
LISTED IN THE FOLLOWING TABLES 



SCALEO 


POINTS 


BELOW ERROR 


BAND 




ID 


NAME 


X AXIS 


Y AXIS 


DIFF 


7 


IT07 


0.59 


-0.08 


0.67 


SCALEO 


POINTS 


ABOVE ERROR 


BANO 




ID 


NAME 


X AXIS 


V AXIS 


DIFF 


25 


IT25 


O 23 


0. 75 


-0,52 


45 


IT45 


0 68 


1 .30 


. -0.62 


.13 


1 133 


-0 19 


0.45 


-0.64 



*1 



j 



48 



. ■ ■ / 

COMPARISON Or 'GROUP !• TO * ALL STUOFNTS' ITEM CALIBRATIONS, GRADE 6 



60 PAIRS 



SCAIEO PLOT or TWO ITEM CALIBRATIONS 



M 
A 
R 
D 
E 
R 



5 00 ♦ 



0 
I 
F 
F 
I 

C 
U 
L 
T 
V 



E 
A 
5 
I 
C 
R 



9 

ERIC 



o.oo ♦ - 




5 0" ♦ 

5 GO 
EASIER 



MEAN A* 
MEAN B" 



0.00 

-o oo 



O.OO 
A DIFFICULTY 

SA^ 1.00 
SB- I OQ 



R* 0.96 RMAXi 0.96 
PAIRS- 60 



GROUP A ITEM CALIBRATIONS FpOM GRADE 6, GROUP 1 
GROUP B : ITEM CALIBRATIONS FROM GRADE 6, ALL STUDENTS 
THE CONFIDENCE INTERVAL REPRESENTS 4. STANDARD ERRORS 
CREATED BY L.H. LOOLOtf: MESA* THE UNIVERSITY OF CHICAGO 
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COMPARISON OF ' GROUP I' TO 'ALL STUDENTS' ITEM CALIBRATIONS, GRADE 6 60 PAIRS 



NOTE THE DOTS REPRESENTING THE STANDARO ERROR BANOS ARE ENTERED INTO THE GRAPH LOCATIONS AFTER THE NUMERALS. THIS MEANS 
THAT PAIRS FALL I NO AT THE SAME LOCATION AS DO DOTS ARE NOT SHOWN AND THE TOTAL NUMBER OF OCCURENCES THAT COULD BE 
COUNTED IN THE PLOT Wl \ NOT EQUAL THE NUMBER OF PAIRS ACTUALLY PLOTTED. THIS CHOICE WAS MADE AS AN AID IN HIGHLIGHTING 
WHERE THE BANDS LIE ANL WHICH PAIRS CLEARLV LIE OUTSIDE THE BAND. PAIRS FALLING ON OR OUTSIDE THE BANOS ARE 
LISTED IN THE FOLLOWING TABLES 

SCALED POINTS BELOW ERROR BANO 



ID 


NAME 


X AXIS 


V AXIS 


DIFF 












47 


IT47 


0.92 


0.44 


0 48 


• 3 


I T 13 


-0.32 


-0.76 


0\.44 



SCALEO POINTS ABOVE ERROR BAND 



44 
34 



ID 



7 



1T07 



IT44 
I 134 



X AXIS 



o.sa 



0 28 
O. 18 



V AXIS 



O. 15 



O 68 

0.60 



-0 40 \ 
-0.42 \ 





50 



51 



ERIC 



GRADE 6 ITEM CALIBRATIONS: COMPARISON OF GROUP 2 TO ALL STUDENTS 



60 PAIRS 



SCALED PLOT OF TWO ITEM CALIBRATIONS 



M 
A 
R 

D 
F 

ft 



D 
I 
F 
F 
I 

C 

u 

L 
Y 
V 



E 
A 
S 
1 
E 
R 



o 

ERIC 



5 OO ♦ 



0 OO ♦ 




5 OO » 

-Ij.OO 
EASIER 



MP AN A * 
MEAN B- 



0.00 
-0.00 



SA* 1.00 
SB' 1.00 



R« 0.98 RMAX 1 
PAIRS* 60 



0,98 



GROUP A: HEM CALIBRATIONS FROM GRADE 6, GROUP 2 
GROUP B: ITEM CALIBRATIONS FROM GRADE 6, ALL STUDENTS 
THE CONFIDENCE INTERVAL REPRESENTS 4. STANDARD ERRORS 
CREATED BV JL.M. LOOLOW: MESA , THE UNIVERSITY OF CHICAGO 
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GRADE 6 ITEM CALIBRATIONS: COMPARISON^ GROUP 3 TO ALL STUDENTS 60 PAIRS 



NOTE: IKE OOTS REPRESENT I NO TH'. STANDARD ERROR BANOS ARE ENTERED INTO THE GRAPH LOCATIONS AFTER THE NUMERALS. THIS MEANS 
THAT PAIRS FALLING AT W£ SAME LOCATION AS 00 OOTS ARE. NOT SHOWN A NO THE TOTAL NUMBER OF OCCURENCES THAT COULD BE 
COUNTED IN THE PCDT WILL NOT EljUAL THE NUMBER pF PAIRS ACTUALLY PLOTTED. THIS CHOICC WAS MADE AS AN AIO IN HIGHLIGHTING 
WHERE THE BANOS LIE ANO WHICH PAIRS CLE ARLV LIE OUTSIOE THE BAND. PAIRS FALLING ON OR OUTSIDt! THE BANDS ARE 
LISTED IN THE FOLLOWING TABLES \ 



SCALED 


POINTS 


BELOW ERROR 


BAND 




ID 


NAME 


X AXIS 


V AXIS 


OIFF 


39 


II2H 


-0 56 


-091 


0 . 35 


SCALED 


POINtS 


ABOVE ERROR 


BANO 




ID 


NAME 


X AXIS 


Y AXIS 


DIFF 


3? 


IT37 


-0 50 


-0.22 


-0..2B 


7 


IT07 


rO 16 


0 15 


-0 31 


10 


IT40 


0.5* 


0 92 


-033 



I ■ 



54 



G»ADf * ITEM CAL I BRAT IONS ! COMPARISON OF GROUP J TO ALL STUDENTS 60 PAIRS 



H 
A 
R 
D 
E 
R 



0 
I 

r 

F 
I 

c 
u 

L 
T 

V 



A 

S 
i 

F 

n 



ERIC 



4 .00 • 



SCALED PLOT OF TWO ITEM CALIBRATIONS 



0 00 ♦ 




4 00 • 

-4 OO 
MSI ER 



MEAN A-» 
MEAN 8» 



O 00 
-O 00 



-0.00 
* DIFFSCULTY 

SA» 1.00 
S9* 1.00 



4 .00 
HARDER 



R- 0.96 RMAX * 0.97 
PAIRS* 60 



GROUP A: ITEM CAL I BRA 1 IONS FROM GRADE 6/ GROUP 3 
GROUP B : ITEM CALIBRATIONS FROM GRADE 6, ALL STUDENTS 
WE CONFIDENCE INTERVAL REPRESENTS 4. STANDARD ERRORS 
CREATED BY L,M. LUDLOW: MESA. THE UNIVERSITY OF CHICAGO 
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GRADE 6 ITEM CALIBRATIONS: COMPARISON OF GROUP 3 TO ALL STUDENTS 



60 PAIRS 



NOTE: THE OOTS REPRESENTING THE STANDARD ERROR BANDS ARE ENTERED INTO THE GRAPH LOCATIONS AFTER THE NUMERALS. THIS MEANS 
I HAT PAIRS FALLING AT THE SAME LOCATION AS 00 OOTS ARE NOT SHOWN A NO THE TOTAL NUMBER OF OCCURENCES THAT COULD BE 
COUNT EO IN THE PtOT WILL NOT EQUAL THE NUMBER OF PAIRS AClUALLV PLOTTED ,' THIS CHOICE W»>S MADE AS AN AID IN HIGHLIGHTING 
WHERE THE BANOS LIE AND WHICH PAIRS CLEARLY LIE OUTSIOE THE BAND. PAIRS FALLING ON OR OUTSIDE THE OA.*>S ARE 
LISTED IN THE FOLLOWING TABLES 



DvAL f. U 


PO 1 N1 S 


RFLriW ERROR 


BAND 




ID 


NAME 


X AXIS 


Y AXIS 


DIFF 


59 


1 159 


0 13 


-0 57 


0.43 


17 


IT 17 


-0.59 


-1,00 ♦ 


0.41 


SCALED 


POINTS 


ABOVE ERROR 


3 A NO 




ID 


NAME 


X AXIS 


v axis 


DIFF 


33 


IT32 


0.36 


0.68 


-0.32 


48 


IT48 


1.30 


1 .79 


-0.49 


39 


1 T39 


0. 15 


0.66 


-0.51 


31 


in* 


-0 AG 


-0 29 


~057 


29 


IT 29 


. - 1 .77 


0.91 


-0,86 



0 
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APPENDIX C 

Fifth and Sixth Ability Estimate Distributions 
Relative to Teacher Determined Retest Band 



(Note: see pages 15, 16 and 17 for fourth grade results.) 



9 

ERIC 



58 



i GRADE 9 MATH. GROUP- 1 STUOENTS 
&5 ITEMS MAX. OF 2 CATEGORIES 

SCALE SCORE EQUIVALENCE TABLE 



RAW 




PROX s 


UCON 


UCON 




SCORE 


COUNT 


POSITION 


POSITION 


ERROR 


PERSON 


54 


0 


4.99 


4.57 


1 .01 




93 


0 


4. 10 


3.84 


0.73 




52 


0 


3.57 


3.39 


0.60 




51 


0 


3. 18 


3.06 


0.53 




50 


0 


2.88 


2.80 


0.49 




49 


0 


2.62 


2.58 


0.45 




48 


0 


2.41 


2.36 


0.43 




47 


0 


2.21 


2.21 


0.41 




46 


0 


2 04 


2.05 


0.39 




45 


0 


1 .88 


1 .90 


0. 38 




44 


0 


1.73 


1 .77 


0.36 




43 


0 


1.60 


1 .64 


0. 35 




42 


0 


1.47 


1 .52 


0.35 


i 


41 


0 


1.34 


1.40 


0.34 




40 


0 


1 .23 


1.29 


0.33 




39 


0 


1.11 


1.18 


0.33 




38 


0 


1 .01 


1.07 


0.32 




17 


0 


1 0.90 


0.97 


0.32 




36 


1 


0.80 


0.87 


0.32 


X 


35 


0 


0.70 


0.77 


0.31 




34 


0 


0.60 


0.67 


0.31 




33 


0 


0.51 


0.58 


0.31 




32 


0 


0.41 


0.48 


0.31 




31 


2 


0.32 


0.39 


0.31 


XX 


30 


0 


0.23 


0 30 


0.31 




29 


1 


0. 14 


0.20 


0.31 


X 


?B 


2 


0.05 


0. 11 


0.31 


XX 


27 


2 


-0.05 


0.02 


0.3? 


XX 


26 


3 


-0. 14 


-0.08 


0,31 


XXX 


25 


4 


-023 


-0. 17 


0 31 


• xxxx 


2i 


1 


-0.32 


-0,27 


0.31 


X 


23 


7 


-0.41 


-0.37 


0.31 


xxxxxxx 


22 


0 


-0.51 


-0.47 


0.32 




21 


4 


-0.60 


-0.57 


0.32 


xxxx 


20 


1 


-0.70 


-0.67 


0.32 


X 


19 


1 


-0.80 


-0.77 


0.33 


X 


18 


2 


-0.90 


-0.88 


0 33 


XX 


17 


0 


-1 .01 


-0.99 


0.34 




16 


1 


-1.11 


-1.11 


0.34 


X 


13 


0 


-1.23 


- 1 ,22 


0.35 




14 


1 


-1.34 


« 1 .35 


0.35 


X 


13 


1 


-1 .47 


-1.48 


0.36 


X 


12 


0 


-1 .60 


-1.61 


037 




1 1 


0 


-1 .73 


-1.76 


0.38 





PERSON FREQUENCY DISTRIBUTION: X- 1 PERSON 



SCALE SCORE EQUIVALENCE TABLE 



HAW 








UCON 


SCORE 


COUNT 


PU5 1 1 I UN 




K» w nun 


10 


1 


— a DO 


• i Of 


o 4Q 

w . ^ V 


g 
w 


o 


-2 .04 


-2.07 


0.41 


8 


0 


-2.21 


-2.25 


0 43 


7 


0 


-2.41 


-2.45 


0.4L 


6 


0 


-2.63 


-2.67 


0.48 


5 


0 


-2.88 


-2.92 


0.52 


4 


0 


-3. 16 


-3.22 


0 56 




0 


-3 57 


-3.59 


0.65 


2 


0 


-4. lO 


-4.09 


0.76 


\ 


0 


-4.99 


-4.89 


1.07 



PERSON FREQUENCY DISTRIBUTION: X-1 PERSON 



60 



55 ITEMS 



GRADE 5 MATH, GROUP -2 STUOENTS 
MAX. OF 2 CATEGORIES 



SCALE SCORE EQUIVALENCE TABLE 



RAW 

SCORE 



COUNT 



PROX 
POSITION 



UCON 
POSITION 



UCON 
ERROR 



PERSON FREQUENCY DISTRIBUTION: X- 1 PERSON 



54 

53 
52 
51 
50 
49 
40 
47 
46 
45 
44 
43 
42 
41 
40 
39 
38 
37 
36 
35 
34 
33 
32 
31 

JL2 



29 
28 

27 
26 
25 
-24. 
23 
22 
21 
20 
19 
18 
17 
16 
15 
14 
13 
12 
1 1 



0 
1 

0 
0 
0 
0 
3 
1 
2 
2 
0 
4 
1 
7 
3 
9 
3 

10 
6 
2 

11 
6 
3 
4 
5 
7 
6 
2 
3 
4 
5 
5 
0 
1 
1 

0 

1 

0 

1 

2 
1 

0 
0 

0 



S.12 
4.21 
3.66 
3.27 
2.96 
2.70 
2.47 
2.27 
2.09 
1.93 
1.78 
1 .64 
1 .51 
1 .38 
1.26 
1 . 14 
1.03 
0.92 
0.82 
0.72 
0.62 
0.52 
0.42 
0.33 
0.23 
0.14 
0.05 
-0.05 
-O 14 
-0.23 
-0.33 
-0.42 
-O 52 
-0.62 
-0.72 
-082 
-0.92 

- 1 .03 
-1.14 
-1 26 

- 1 .38 
-1.51 
-1.64 
-1.78 



4.68 
3.94 
3.49 

3. 16 
2.89 
2.66 
2.46 
2.29 
2. 12 
l.»7 
1 .83 
1.70 



57 
45 

33 
21 
10 
1 00 
0.89 
0.79 
69 
58 



0 
0 
O 

0 
0 
0 
0 
-0 
-0 
-0 



48 

39 
29 
19 
09 
01 
11 
21 



-0.31 
-0.41 
-0.51 
-0.61 
-0.72 
-0.82 
-0.93 
-1 .05 
-1. 16 
-1 .28 
-1.41 
-1 .54 
-1.67 
-1.81 



1.01 
0.74 
0.60 
0.54 
0.49 
0.46 
6.43 
041 
0.40 
0.38 
0.37 
0.36 
0.35 
0.35 
0.34 
033 
0.33 
0.33 
0.32 
0.32 
0.32 
0,32 
0.32 
0.31 
0.31 
0.31 
.31 
.31 
.31 
.32 
,32 
.32 
0.32 
0.32 
0.33 
0.13 
0.33 
0.34 
0.34 
0.35 
0.36 
0.36 
0.37 
0.38 



0. 
0. 
0. 

0. 
0» 
0. 



XXX 
X 

XX 
XX 

XXXX 
X 

xxxxxxx 

XXX 

xxxxxxxxx 

XXX 

XXXXXXXXXX 

xxxxxx 

XX 

XXXXXXXXXXX 

xxxxxx 

XXX 
XXXX 

xxxxx 
xxxxxxx 
xxxxxx 

XX 
•XXX 
XXXX 
ftX>{XX 



xxxxx 

X 
X 



X 

XX 
X 



9 

ERIC 



61 



55 ITEMS 



: GRADE 5 MATH, GROUP-3 STUDENTS 
MAX . Of 2 CATEGORIES 



SCALE SCORE EQUIVALENCE TABLE 



RAW 




HKUa 








SCORE 


COUNT 


one f it f nil 
PU5I T ION 




ERROR 


PERSON 


54 


Q 


a 7 1 
4 « f 1 


4 44 


1 .01 




53 


0 


■ 1 fit • 
J „ IS f 


1 7 1 

J * f 1 


O 73 




52 


o 


1 If 

J. Jr 


1 97 


\* ■ vv 




51 


0 


1 A 4 


9 on 


n m 




50 


0 


2 • 72 


1 CO 


n 4A 




49 




2 . 40 


9 17 






48 


0 


2 . 27 


9 on 
4 . 40 


4 9 
U . 4 4 




47 


6 


2 . 09 


9 4 4 






46 


i 


4 rt ^ 

i . 93 


4 QA 


yj . jo 


y 

A 


45 


1 


1 .78 


1.81 


0. 37 


X 


44 


0 


A r* a 

1 .64 


4 CA 
1 . DO 






43 


0 


1.51 


4 Cft 


n IK 




42 


0 


1 . 39 


4 4 9 


n id 




4 1 


0 


4 1 *f 

1 . 27 


l . J4 






, 40 


0 


1 . 16 


4 9 4 
1.41 


U. J J 




39 


0 


1 .05 


1.11 


U . J2 




38 


1 


0.95 




U . 34 


y 

A 


37 


1 


0. 85 


/\ Of 


rt* 1 4 


y 

A 


36 


0 


0 . 75 


/\ a 4 
OB 1 


n 1 4 




35 


0 


0 • 66 


n 7 4 

O. f i 


n 1 4 




34 


0 


4C *v 

0. 57 


A CI 
U . 04 


n 1 4 




33 


0 


0 . 48 


f\ CO 

0 . 9 J 


n in 




32 


2 


0 . 39 


U . 44 


n in 


yy 

AA ■ 


31 


2 


0 . 30 


U . J4 


n in 


A A J 


.in 


2 


0 . 22 


/\ lit 


n in 


MM ' 


29 


4 


0. 13 


/\ 4 C 


n in 


MMMM 

A A A A 


28 


4 


0 .04 


O . Of 


n in 


y yyy 

A A A A 


27 


3 


-0.04 


-O . U2 


o . JU 


yyy 

AAA 


26 


1 
4 


-n i 1 


-0. 1 1 


0.30 


XX 


25 


3 


-0.22 


-0.20 


0.30 


XXX 


2i 


4 


-0.30 


-0.29 


0.30 


MX*..,.. 


23 


6 


-0 . 39 . 


-0.38 


0.31 


xxxxxx 


22 


3 


-0.48 


-0.47 * 


0.31 


XXX 


21 


1 


-057 


-0.57 


0.31 


X 


20 


0 


-0.66 


-0.67 


0.31 




19 


2 


-0 75 


-0.77 


0.32. 


XX 


IB 


1 


-0 85 


-0.87 


0.32 


X 


17 


0 


-0.95 


-0.97 


0.32 




16 


0 


-1 05 


-1.08 


0.33 




IB 


4 
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